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(54) SIGNAL ENCODING DEVICE, METHOD, SIGNAL DECODING DEVICE, AND METHOD 



(57) A signal encoding apparatus (10) limits an in- 
putted time series signal to a low frequency band signal 
having a certain cut-off frequency or less to include the 
low frequency band signal into code train for outputting 
encoded low frequency band code train. In addition, the 
signal encoding apparatus (10) adaptively determines 
aliasing frequency f^, shift frequency or tone-noise 
synthesis information r used for generation of high fre- 
quency band signal at the decoding side to include these 



infonnation into code train outputted along with high fre- 
quency band spectrum envelope infonnation as high 
frequency band generation information. A signal decod- 
ing apparatus generates a high frequency band signal 
from a low frequency band signal by using high frequen- 
cy band signal generation Information included in code 
train and high frequency band spectrum envelope to add 
the generated high frequency band signal and the low 
frequency band signal to thereby output a time series 
signal extended up to the high frequency band signal. 
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Description 

Technical Field 

5 [0001 J The present invention relates to a signal encoding apparatus and a method therefor, a signal decoding ap- 
paratus and a method therefor, a program and a recording medium which are suitable when used in the case where 
time series signal limited to frequency band which is the encoding side Is extended to signal In broader frequency band 
at the decoding side. 

[0002] This Application clainris priority of Japanese Patent Application No. 2002-241052, field on August 21 , 2002, 
10 the entirety of which is incorporated by reference herein. 

Background Art 

[0003] In recent years, in efficient encoding of audio signal, mechanism of auditory sense of the human being is 
IS utilized to thereby have ability to compress data quantity having sound quality corresponding to CD (Compact Disk) 
into data quantity of about 1/10 of the original CD. At present, goods utilizing theses technologies are circulated also 
on the market, and it is realized that audio signals are recorded on smaller recording media, and/or are distributed 
(delivered) through network. 

[0004] In such efficient compression, individual formats are respectively employed. If corresponding fomriat is within 
20 the range of fomnat, it is possible to freely control, to some degree, sound quality and bit rate at the encoding side. For 
example, also with respect to Mini Disk (MD) (Trade Mark by Sony Corporation), two modes of LP2 and LP4 using the 
same efficient compression technology exist as the long time recording mode. In the case of LP4, data is further 
compressed into one half with respect to LP2 to thereby pemriit recording time which is two times greater than that of 
LP2 while sound quality is inferior. 
25 [0005] However, in such efficient compression technology, since design and standardization are made in the state 
where bit rate and sound quality are clearly determined as target, when bit rate is further lowered while maintaining 
standard (fomnat), sound quality is extremely deteriorated. In order to avoid such circumstances, there is generally 
employed a method of perfomning improvement in efficient coding algorithm at the encoding side, or limiting signal in 
the high frequency band where auditory sense of human being is dull to distribute extra bits to signal in the lower 
30 frequency band. 

[0006] Meanwhile, in the case where signal in the high frequency band is limited in order to maintain sound quality 
to lower bit rate while maintaining the fomnat in a manner as described above, there is also a trial for reproducing signal 
in the high frequency band at the decoding side. For example, there are such a technology to double reproduction 
frequency band of PCM signal of 44.1 kHz sampling which is described in the Japanese Patent Publication Laid Open 
35 No. 1 990-311 006, and such a technology to extend frequency band of telephone at the receiving side which is described 
in the Japanese Patent Publication Laid open No. 1997-55778. 

[0007] The technologies as stated above have the merit that change of fomnat is not required so that it is sufficient 
to perform improvement only at the decoding side, but do not exhibit dramatic effect in point of sound quality because 
there is a necessity to extend the frequency band only from received signal, and are such that distortion from viewpoint 

40 of auditory sense is offensive to the ears in the high frequency band particularly in the case where there does not so 
exist correlation between low frequency band and high frequency band, etc. in dependency upon inputted sound source. 
[0008] Moreover, in the above-described Japanese Patent Publication Laid Open No. 1997-55778, pitch analysis is 
perfonned at the time of decoding to add spectmm of frequency of multiple of n thereof to signal in the high frequency 
band to thereby extend frequency band of telephone at the receiving side. Since it is rare that plural pitches exist in 

45 the case of sound (speech) for telephone use, whereas there are many instances where plural pitches are included in 
the case of general audio signal, employment of such method is not effective, and there are many cases where pitch 
analysis does not function from the beginning. 

[0009] On the other hand, in the case where format is extended so that band-limited reproduction is pemnitted to be 
perfomned in equipments which employ conventional fomnat, and reproduction of high quality in which frequency band 

50 has been extended is pemnitted to be perfomned in equipments which employ new fomnat, both change at the encoding 
side and that at the decoding side are required. In this case, result which is better than that by improvement only at 
the decoding side can be obtained. For example, in the technology for improving dynamic range and reproduction band 
of CD which is called HDCD, parameter such as filter kind, etc. for extending frequency band is hidden into the con- 
ventional fomnat so that it is below audible level to thereby realize improvement in quality. 

55 [001 0] In addition, without being limited to such extension of format as described above, in mobile telephone and/or 
semiconductor recording equipment such as flash media, etc., it is desirable to have low bit rate and to have higher 
sound quality. Further improvement in perfomnance by introducing new technology with respect to the existing Codec 
by wavefomn encoding is required. 



2 



EP 1 531 551 A1 

Disclosure of the Invention 

[0011] The present Invention has been proposed in view of such conventional actual circumstances, and its object 
Is to provide a signal encoding apparatus and a method therefor which can generate optimum harmonic wave (higher 
5 harmonic) at a frequency band extended at the time of decoding even in the case where complicated harmonic wave 
exists, a signal decoding apparatus and a method therefor which decode code trains outputted from the signal encoding 
apparatus, a program for allowing computer to execute such signal encoding processing and signal decoding process- 
ing, and a computer readable recording medium where such program is recorded. 

[0012] To attain the above-described object, in the signal encoding apparatus and the method therefor according to 
10 the present invention, in orthogonaliy transforming inputted time series signal to encode the time series signal thus 
transformed, spectrum of limit band corresponding to a predetermined frequency band of the inputted time series signal 
is encoded, and mapping Infonnation indicating a method of mapping is adaptively generated in order to determine 
time series signal of frequency band to be extended at the decoding side on the basis of mapping of spectrum of the 
limit band to output the encoded spectrum of the limit band and the mapping information. 
'5 [0013] Moreover, in order to attain the above-described object, in the signal decoding apparatus and the method 
therefor according to the present invention, encoded spectrum of limit band corresponding to a predetermined frequen- 
cy band of a time series signal inputted at the encoding side, and mapping information indicating a method of mapping 
which has been adaptively generated in order to detemnine a time series signal of a frequency band to be extended 
at the decoding side on the basis of mapping of the spectrum of limit band are inputted to decodethe encoded spectrum 
20 of limit band to generate a time series signal of limit band, and to determine, on the basis of the mapping information, 
spectrum of extension band to be extended from the spectrum of limit band to inverse-orthogonally transform the 
spectrum of the extension band to generate a time series signal of the extension band to add the time series signal of 
the limit band and the time series signal of the extension band to output added signal. 

[0014] In accordance with the signal encoding apparatus and the method therefor, and the signal decoding apparatus 
25 and the method therefor which have been described above, spectrum of limit band corresponding to a predetermined 
frequency band of inputted time series signal is encoded at the encoding side, and mapping information indicating a 
method of the mapping is adaptively generated in orderto determinetime series signal of frequency band to be extended 
at the decoding side on the basis of mapping of the spectrum of the limit band. Further, at the decoding side, the 
encoded spectrum of the limit band is decoded to generate time series signal of limit band, and to generate, on the 
30 basis of the mapping information, time series signal of extension band to be extended from the spectrum of limit band 
on the basis of the mapping information to add the time series signal of the limit band and the time series signal of the 
extension band to output added signal. 

[0015] In addition, the program according to the present Invention serves to allow computer to execute the above- 
described signal encoding processing or signal decoding processing, and the recording medium according to the 
35 present invention is directed to computer readable recording medium where such program is recorded. 

[001 6] Still further objects of the present invention and practical merits obtained by the present invention will become 
more apparent from the description of the embodiments which will be given below. 

Brief Description of the Drawings 

40 

[0017] 

FIG. 1 is a view for explaining outline of the configuration of a signal encoding apparatus in this embodiment. 
FIGS. 2A and 2B are views showing, in a model form, the state of normalization of spectrum at spectrum envelope 
analysis generating circuit of the signal encoding apparatus, wherein FIG. 2A shows spectrum envelopes of low 
frequency band signal and high frequency band signal, and FIG. 28 shows spectrum envelope of spectrum nor- 
malized on the basis of the spectrum envelope. 

FIG. 3 is a flowchart for explaining the procedure which detemriines aliasing frequency at high frequency band 
signal generation infonnation extracting circuit of the signal encoding apparatus. 
50 FIG. 4 is a view showing, in a model form, the state for detennining aliasing frequency. 

FIG. 5 is a flowchart for explaining the procedure which determines shift frequency at high frequency band signal 

generation information extracting circuit of the signal encoding apparatus. 

FIG. 6 is a view showing, in a model form, the state for determining shift frequency. 

FIG. 7 is a view for explaining outline of the configuration of a signal decoding apparatus in this embodiment. 
55 FIG. 8 is a view schematically showing internal configuration of high frequency band signal generating circuit in 

the signal decoding apparatus. 

FIG. 9 is a flowchart for explaining processing procedure in the case where tone signal spectrum is generated by 
making use of aliasing frequency at tone signal generating circuit within the high frequency band signal generating 
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circuit. 



10 



15 



FIG. 1 0 Is a view showing, in a model fomi, the state of aliasing of nomialized low frequency band spectrum at 
the tone signal generating circuit. 

FIG. 11 is a flowchart for explaining processing procedure in the case where tone signal spectrum is generated 
by matang use of shift frequency at tone signal generating circuit within the high frequency signal generating circuit 
FIG. 12 IS a view showing, in a model fomi. the state of shift of normalized low frequency band spectrum In the 
tone signal generating circuit. 

FIG. 1 3 is a flowchart for explaining processing procedure of signal encoding apparatus in the case where aliasing 

processing or shift processing is designated by high frequency band generation method flag 

FIG. 1 4 IS a flowchart for explaining processing procedure of signal decoding apparatus in the case where aliainq 

processing or shift processing is designated by high frequency band generation method flag 

FIG. 15 Is a view showing the entire configuration of system to which the signal encoding apparatus and the signal 

decoding apparatus are applied. ^ 

FIGS^ 1 6A and 1 6B are views showing respective examples of formats of data trains in the conventional standard 

and the standard of this embodiment, wherein FIG. 1 6A shows data train of the conventional standard which has 

no extension data area, and FIG. 16B shows data train of the standard of this embodiment which has extension 

data area. 
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Best Mode for Carrying Out the Invention 

[00181 Explanation will be given below in detail with reference to the attached drawings in connection with practical 
embodiments to whwh the present invention is applied. In the embodiments, the present invention is applied to a signal 
encoding apparatus and a method therefor which limit inputted time series signal to low frequency band (low frequency 
band signal), and a signal decoding apparatus and a method therefor which extend that time series signal to high 
frequency band (high frequency band signal) by using mapping of low frequency band spectrum on the frequency axis 
e.g.. aliasing or shift (parallel displacement). ' 
[0019] Simply speaking, in this embodiment, while limiting an inputted time series signal to a low frequency band 
signal having a predetemnined cut-off frequency f, or less at the encoding side, aliasing frequency f, or shift frequency 
fsh. etc. used for generation of high frequency band signal at the decoding side is adaptively deteimined Further at 
the decoding side, low frequency band spectrum on the frequency axis is caused to undergo aliasing symmetrically 
with aliasing frequency f^ inputted from the encoding side being as center, or is shifted by 2f^ - f,, on the basis of shift 
frequency f^^ to generate a high frequency band signal on the basis of the spectmm which has been caused to undergo 
aliasing or the shifted spectrum. ^ 
[0020] First, outline of the configuration of a signal encoding apparatus in this embodiment is shown in FIG 1 As 
shown in FIG. 1 , the signal encoding apparatus 1 0 in this embodiment is composed of a low-pass fitter (LPR 11 a low 
frequency band signal encoding circuit 12, a delay circuit 13. a difference circuit 14. spectmm envelope analysis gen- 
■'^•^ '^'9'' fr^^^"*^ ''and signal generation infomiatlon extracting circuit 17, and a multiplexer 18 
[0021] The low-pass filter 1 1 limits an inputted time series signal to a low frequency band signal having a predeter- 
mined cut-off frequency f, or less to deliver this low frequency band signal to the low frequency band signal encoding 
circuit 12. the difference circuit 14 and the spectrum envelope analysis generating circuit 15 

[0022] The low frequency band signal encoding circuit 12 orthogonally transforms, every predetemiined frame low 
frequency band signal through the low-pass filter 1 1 to encode that signal to deliver the low frequency band code train 
thus obtained to the multiplexer 18. 

'TfK 7''!'*®'^y''''^"'*^^''^*''^^«'^®*^^'«y«"^s««thatofthelow-passfilter11.andservestotakesynchroniz^^^^^ 
with the low frequency band signal which has been filtered at the low-pass filter 11 with respectto inputted time series 
signal thereafter to deliver this time series signal to the difference circuit 1 4 

^°°^?} , '^^^'^''''^ ^^'^"rt 14 takes difference between the time series signal delivered from the delay circuit 13 
and the low frequency band signal delivered from the low-pass filter 11 to generate a high frequency band signal The 
rn^oT'^tu """" ^ '^^'"^'^ ^^'^ "'^^ frequency band signal to the spectmm em^elope analysis generating circuit 1 6 
[0025] The spectrum envelope analysis generating circuit 1 5 analyzes the delivered low frequency band signal to 
generate low frequency band spectrum envelope to deliver, to the high frequency band signal generation infomiation 
extracting circuit 1 7. nomialized low frequency band spectrum obtained by normalizing low frequency band spectmm 
by this low frequency band spectrum envelope. ^ f H«.uum 

[0026] Similariy, the spectmm envelope analysis generating circuit 16 analyzes high frequency band spectmm ob- 
tained by orthogonally transfomning the delivered high frequency band signal eveiy predetermined frame to generate 
high f requency band spectmm envetope to generate high frequency band spectmm envelope infomiation for outputting 
the high frequency band spectmm envelope and nomialized high frequency band spectmm obtained by nornializing 
the high frequency band spectmm by the high frequency band spectmm envelope. Further, the spectmm envetope 



4 



EP 1 531 551 A1 



analysis generating circuit 1 6 delivers tiie nomnalized high frequency band spectrum to the high frequency band signal 
generation information extracting circuit 17, and delivers the high frequency band spectrum envelope information to 

the multiplexer 18. 

[0027] The high frequency band signal generation information extracting circuit 17 performs analysis on the basis 
of the nomialized high frequency band spectrum and the normalized low frequency band spectrum to generate high 
frequency band signal generation Information for generating high frequency band signal at the decoding side. Here, 
as this high frequency band signal generation infomrtation, tone-noise mixture infonnation r (0.0< r <1 .0) indicating tone 
characteristic and noise characteristic are mentioned in addition to aliasing frequency f^ and shift frequency fsh- This 
tone-noise mixture information r can be determined in accordance with the following formula (1) as described below 
within the range, e.g., from generation start frequency of normalized low frequency spectrum to termination frequency 
of normalized high frequency band spectrum. Here, in the formula (1), S^^^^ Indicates the maximum value of spectrum 
and indicates average value of spectrum. In addition, A indicates a predetennlned constant, 

r = AxS^3,/S3^3(0.0<r<1.0) (1) 

[0028] The multiplexer 1 8 collectively outputs, as one code train, low frequency band code train delivered from the 
low frequency band signal encoding circuit 12, high frequency band signal generation information delivered from the 
spectrum envelope analysis generating circuit 16, and high frequency band spectrum envelope infonnation delivered 
from the high frequency band signal generation infonnation extracting circuit 17. 

[0029] Here, the states of normalization of spectrum at the spectrum envelope analysis generating circuits 15, 16 
are shown in FIGS. 2A and 2B in a model form. FIG. 2A shows, in combination, high frequency band spectrum envelope 
included in code train in the state where it is changed into parameter and low frequency band spectrum envelope 
prepared from low frequency band signal. In this case, f^-fg in FIG. 2A indicate peak positions of spectrum, and f^ 
indicates cut-off frequency of the low-pass filter 11 (FIG. 1). Spectrum is nomnalized on the basis of this spectrum 
envelope. Spectrum envelope of the nomnalized spectrum is shown in FIG. 2B 

[0030] In this way, spectrum is normalized by spectrum envelope to thereby have ability to determine aliasing fre- 
quency fa or shift frequency f^^ in the state where weight is placed on the peak position of spectrum. Thus, accuracy 
of high frequency band signal generated at the decoding side can be improved. It is to be noted that in the case where 
restriction in processing time or hardware exists, processing of this normalization may be omitted in the state where 
accuracy is sacrificed. 

[0031] Explanation will be given below in order in connection with the procedure for determining aliasing frequency 
fa or shift frequency fg^ at the above-described high frequency band signal generation infonnation extracting circuit 1 7 
on the basis of the normalized low frequency band spectrum and the normalized high frequency band spectrum which 
have been described above. 

[0032] First, explanation will be given by using the flowchart of FIG. 3 in connection with the procedure for determining 
aliasing frequency f^ at the high frequency band signal generation infonnation extracting circuit 17. Hereinafter, nor- 
malized high frequency band spectrum is expressed as F_high. Particularly, it is assumed that F_high(f) represents 
spectrum of frequency band higher than frequency f. Moreover, nomnalized low frequency band spectrum is expressed 
as FJow(f). Particulariy, it is assumed that F_low'(f) represents spectrum obtained by allowing low frequency band 
spectrum FJow(f) less than frequency f to linearly synmetrically undergo aliasing with the frequency f being as center. 
In addition, fa_min and fa_max respectively indicate lower limit value and upper limit value of frequency serving as 
search range in determining aliasing frequency f^. The fa_min and the fa_max may be fixed by standard, or may be 
arbitrarily set within the range of that standard by encoder. 

[0033] First, at step 31 , the minimum value min serving as internal variable is set to infinite value, and frequency f 
is set to fa_mln as initial value. 

[0034] Subsequently, at step S2, distance df between vectors in the case where F_high(f) and FJow'(f) are respec- 
tively regarded as vector is calculated in accordance with the following fonnula (2). Here, in the formula (2), i indicates 
index of discrete frequency, and n^ indicates the number of samples up to frequency f. In addition, S_low'(i) indicates 
magnitude of FJow'(f) at the discrete frequency i, and S_high(i) indicates magnitude of F_high(f) at the discrete fre- 
quency i. 
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^\S_low'{i)-S_highii)\' 

df = -• (2) 

'»/ 

[0035] Namely, as Indicated in a model fomri in FIG. 4, square of difference of magnitude (level) between FJow*(0 
10 and F_hlgh(f) (=lSJow'(i) - S_high(i)!2) is cumulatively added with respect to the range from discrete frequency f to 
discrete frequency 2f to allow the added value thus obtained to be distance dj. 

[0036] Returning to FIG. 3 for a second time, at step S3, whether or not distance d^ Is less than the minimum value 
min Is discriminated. In the case where the distance df is less than the minimum value min (Yes), the minimum value 
min is updated into df at the subsequent step S4 to preserve (store) frequency f at that time as aliasing frequency f^. 

15 On the other hand, in the case where distance df Is the minimum value min or more (No) , p rocessi ng proceeds to step S6 . 
[0037] At the step S5, whether or not frequency f falls within the range from fa_min to fa_max is discriminated. In 
the case where the frequency f falls within the range from fa_min to fa_max (Yes), the frequency f is incremented at 
step S6 to return to the step S2. On the other hand, in the case where the frequency f does not fall within the range 
from fa_min to fa_max (No), aliasing frequency f^ preserved (stored) at present Is established to Include the aliasing 

20 frequency f^ thus established Into the above-described high frequency band signal generation infonnation. 

[0038] Then, explanation will be given by using the flowchart of FIG. 5 in connection with the procedure for deter- 
mining shift frequency f^^ at the high frequency band signal generation information extracting circuit 17. Similarly to 
the above, nomialized high frequency band spectrum is represented as F_high. Particularly, it Is assumed that F_high 
(f) represents spectrum having frequency band higher than frequency f. Moreover, nomnallzed low frequency band 

25 spectrum is represented as FJow. Particularly, it is assumed that F_low'(f) represents spectrum obtained by shfting 
low frequency band spectrum F_low(f) having frequency lower than frequency f by, e.g., 2fc - f. Further, fsh-iT^'" anci 
fgf^max respectively indicate tower limit value and upper limit value of frequency serving as search range in determining 
shift frequency fgh- The fsh_min and the fsh-"iax may be fixed by standard, or may be arbitrarily set within the range 
of that standard by encoder. 

30 [0039] First, at step 81 0, the minimum value min serving as internal variable is set to Infinite value, and frequency f 

is set to fsh_min as initial value. 

[0040] Then, at step 811 , distance df between vectors in the case where F_high(f) and FJow*(f) are respectively 
regarded as vector is calculated In accordance with the following formula (3). Here, in the formula (3), i indicates index 
of discrete frequency, and nf Indicates the number of samples up to frequency f . In addition, 8_low'(l) indicates mag- 
35 nitude of FJow*(f) at discrete frequency i, and S_high(i) indicates magnitude of F_high{f) at discrete frequency i. 

'ii\S _low\i) - S _high{ii( 

df^'-=l^ - (3) 

«/ 

45 [0041] Namely, as shown in a model fonm in FIG. 6, sqaure of difference of magnitude between FJow'(f) and F_high 
(f) (=lS_low'(i) - S_high{i)|2) Is cumulatively added with respect to the range from discrete frequency 2fc - f to discrete 
frequency 2f to allow the added value thus obtained to be distance d,. 

[0042] Returning to FIG. 5 for a second time, at step 812, whether or not distance df is less than the minimum value 
min is discriminated. In the case where the distance df is less than the minimum value min (Yes), the minimum value 
50 min is updated into df at the subsequent step 81 3 to preserve (store) frequency f at that time as shift frequency fsf,. On 
the other hand, in the case where the distance df is the minimum value min or more (No), processing proceeds to step 
814. 

[0043] At the step 814, whetheror not the frequency f falls within the range from fg^min to fgf^max is discriminated. 
In the case where the frequency f falls within the range from fsh-iTi'n to f^^^max (Yes), the frequency f is incremented 
55 at step 815 to return to the step 811 . On the other hand, in the case where the frequency f does not fall within the 
range from fsfv_mjn to fsh_fTiax (No), shift frequency f^f, preserved (stored) at present Is established to Include that shift 
frequency into the above-described high frequency band signal generation information. 

[0044] As explained above, the signal encoding apparatus 10 in this embodiment limits Inputted time series signal 
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to a low frequency band signal having cut-off frequency f^ or less to Include this tow frequency band signal Into code 
train for outputling encoded low frequency band code train, 

[0045] Moreover, the signal encoding apparatus 1 0 adaptively detennlnes aliasing frequency f^, shift frequency t^, 
and/or tone-noise synthesis infomnation r used for generation of high frequency band signal at the decoding side to 
include, as high frequency signal generation infomnation, these Infonnation into code train to be outputted along with 
high frequency band spectrum envelope information. 

[0046] Subsequently, outline of the configuration of a signal decoding apparatus in this embodiment which generates 
high frequency band signal while using the above-described high frequency band signal generation infonnation, etc. 
is shown in FIG. 7. As shown in FIG. 7, the signal decoding apparatus 30 in this embodiment is composed of a demul- 
tiplexer 31 , a low frequency band signal decoding circuit 32, a spectrum envelope generating circuit 33, a spectrum 
envelope anaiysis generating circuit 34, a high frequency band signal generating circuit 35. and an adding circuit 36. 
[0047] The demultiplexer 31 separates the code train inputted from the signal encoding apparatus 10 (FIG. 1) into 
three information of low frequency band signal code train, high frequency band spectrum envelope infomnation and 
high frequency band signal generation information to respectively deliver them to the low frequency band signal de- 
coding circuit 32, the spectrum envelope generating circuit 33 and the high frequency band signal generating circuit 35. 
[0048] The low frequency band signal decoding circuit 32 decodes low frequency band signal code train delivered 
from the demultiplexer 31 to deliver decoded low frequency band signal thus obtained to the spectrum envelope analysis 
generating circuit 34, the high frequency band signal generating circuit 35 and the adding circuit 36. 
[0049] The spectrum envelope generating circuit 33 generates high frequency band spectrum envelope on the basis 
of the high frequency band spectrum envelope information delivered from the demultiplexer 31 to deliver this high 
frequency band spectrum envelope to the high frequency band signal generating circuit 35. 

[0050] The spectrum envelope analysis generating circuit 34 analyzes the decoded low frequency band signal de- 
livered from the low frequency band signal decoding circuit 32 to generate low frequency band spectrum envelope to 
deliver this low frequency band spectrum envelope to the high frequency band signal generating circuit 35. 
[0051] The high frequency band signal generating circuit 35 generates high frequency band signal in a manner as 
described later by using the high frequency band spectrum envelope, the low frequency band spectrum envelope, the 
low frequency band signal and the high frequency band signal generation information to deliver the generated high 
frequency band signal thus obtained to the adding circuit 36. 

[0052] The adding circuit 36 adds the decoded low frequency band signal delivered from the low frequency band 
signal decoding circuit 32 and the generated high frequency band signal delivered from the high frequency band signal 
generating circuit 35 to output final time series signal. 

[0053] IHere, the internal configuration of the above-described high frequency band signal generating circuit 35 is 
schematically shown in FIG. 8. As shown in FIG. 8, the high frequency band signal generating circuit 35 is composed 
of a noise signal generating circuit 40, a tone signal generating circuit 41 , and a comparative synthesis circuit 42. 
[0054] The noise signal generating circuit 40 generates noise signal by using high frequency band spectrum envelope 
and high frequency band signal generation infonnation. This noise signal is a signal in which high frequency band 
spectrum envelope is caused to be amplitude on the frequency area, and phase is random as indicated by the following 
fomnula (4). In this case, in the fomnuia (4), k indicates discrete frequency, NS indicates noise spectrum which is complex 
number, Re{ } indicates real part of complex number, Im { } indicates imaginary part of complex number, and r indicates 
the above-described tone-noise mixture infonnation. In addition, E indicates high frequency band spectrum envelope, 
6r indicates random phase, and RND( ) indicates random number uniformly distributed within the range from 0 to 1 . 

Re{NS{k)} = r x E(k) x cos (Or) 



lm{NS(k)} = r x E(k) x sin (Or) (4) 



er = 2 X jc X RND() 

[0055] The noise signal generating circuit 40 delivers noise signal spectrum obtained by the fomnula (4) to the com- 
parative synthesis circuit 42. 

[0056] On the other hand, the tone signal generating circuit 41 generates tone signal spectrum In a manner as 
described later by using the high frequency band spectrum envelope, the high frequency band signal generation in- 
formation, the low frequency band spectrum envelope and the decoded low frequency band signal. The tone signal 
generating circuit 41 delivers the generated tone signal spectrum to the comparative synthesis circuit 42. 
[0057] The comparative synthesis circuit 42 makes comparison between magnitudes on the frequency axis with 
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respecttonoisesignalspe<rtmmdeliveredfromthenoise signal generatingcircuit 40 andtone signal sp^^^ 
from the tone signal generating circuit 41 to select larger spectrum every discrete frequency to generate synthesEed 
spectrum. Further, the comparative synthesis circuit 42 allows this synthesized spectrum to undergo Inverse Discrete 
Fourier Transform (IDFT) to transform it into time series signal to further implement windowing thereto to output, as 
the above-described generated high frequency band signal, signal which has been overlap-synthesized with output 

signal of previous frame. , . r-.r-a 

roOSBl Here practical processing procedure at the tone signal generating circuit 41 will be explained by using FIGS. 
9 to 1 2. This tone signal generating circuit 41 can generate tone signal spectrum on the basis of aliasing frequency 
or shift frequency f^h included in high frequency band signal generation infomiation. 

[00591 First processing procedure in the case where tone signal spectrum is generated by making use of aliasing 
freouencvf isshown in FIG. 9. At step S20 of FIG. 9, decoded lowfrequency band signal is caused to undergo DKcrete 
Fourier Tra^sfomi (DFT) to generate decoded low frequency band spectrum. At the subsequent step S21 , the decoded 
low frequency band spectrum thus obtained is divided by low frequency band spectrum envelope so that it is nomialized. 
ro060] Subsequently, at step S22, the nomialized lowfrequency band spectmm is caused to undergo aliasing linearly 
symmetrically with aliasing frequency f^ included in the high frequency band signal generation infomfiation being as 
contsr 

[00611 The state of aliasing of this normalized low frequency band spectrum is shown in a model fomti in FIG. 1 0. It 
is to be noted that only spectrum components of peak positions at normalized low frequency band spectrum are rep- 
resented in FIG 10 When frequencies of spectrum components of peak positions are assumed to be respectively fi. 
f, fofrom low frequency band, f,. fg, h are caused to respectively undergo aliasing toward f,. fg, fg by using allying 
frequency f^. The relationship between the f „ (n = 1 , 2. 3) and f „ can be represented by the fomiula (5) as described 
below. 

fn" =fa + (fa-fn) = 2 X fa-fn (5) 

[0062] Returning to FIG. 9 for a second time, at step S23. high frequency band spectrum envekjpe is applied to 
qenerated high frequency band spectmm which has been made by this aliasing. ^ ^ • »u 

(0063] Further, at step S24, correction of gain is perfonmed by using tone-noise mixture infonnation r included in the 
hiqh frequency band signal generation infonnation. 

[00641 Then processing procedure in the case where tone signal spectrum is generated by making use of shift 
frequency ^ is shown in FIG. 11 . At step S30 of FIG. 11 . decoded low frequency band signal is caused to unde^o 
Discrete Fourier Transform (DFT) to generate decoded low frequency band spectrum. At the subsequent step ^1 
the decoded low frequency band spectrum thus obtained is divided by low frequency band spectrum envelope so that 

[006rj"^sStquently, at step S32, the nonnalized low frequency band spectrum is shifted by - by using shift 
frequency f.h included in the high frequency band signal generation infonnation. 

[00661 The state of shift of this nomialized low frequency band spectmm is shown in a model fonn in FIG. 12. It is 
to be noted that only spectmm components of peak positions at the nomnalized low frequency band spectrum are 
represented In this FIG. 12. When frequencies of spectmm components of peak positions are assumed to be respec- 
tively f , U. U from low frequency band, f,, fg. h are respectively shifted to f, , fj, f'a by using shift frequency f.^. The 
relationship between the fn (n = 1 . 2, 3) and f „ can be represented by the fonnula (6) as descnbed below. 

fn' =fn + (2.fc-fsh) (6) 

[0067] Retuming to FIG. 11 for a second time, at step S33, high frequency band spectrum envelope is applied to the 
generated high frequency band spectmm which has been made by this alasing. 

[0068] Further, at step S34, correction of gain is perfomfied by using tone-noise synthesis infonnation r included in 
the high frequency band signal generation infonnation. 

[0069] As explained above, the signal decoding apparatus 30 in this embodiment generates high frequency band 
signal from low frequency band signal by using high frequency band signal generation information including aliasing 
frequency f shift frequency f^. and tone-noise mixture infonnation r, and high frequency band spectmm envelope 
which are included in code train to add this generated high frequency band signal and the low frequency band signal, 
thereby making it possible to output time series signal extended up to high frequency band signal. 
[0070] It is to be noted that while explanation has been given in the above explanation on the premise that only one 
of aliasing processing and shift processing is perfomied, both processing may be conducted in parallel every frame in 
thecase where there is margin in processing to designate, by high frequency band generation method flag, the process- 
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ing by which good result can be obtained. 

[0071] The processing procedure at the signal encoding apparatus 10 In this case will be explained by using the 
flowchart of FIG. 13. First, at step S40, aliasing processing is perfornned by the procedure which has been already 
explained by using FIGS. 3 and 4 to preserve (store) least square error d^ and the aliasing frequency thereof. 
5 [0072J Then, at step S41 , shift processing is perfonned by the procedure which has been already explained by using 
FIGS. 5 and 6 to preserve (store) least square error d^^ anci the shift frequency fg^ thereof. 

[0073] Subsequently, at step 842, two least square errors are compared. Specifically, for exannple. whether or not 
least square error d^ in the case where aliasing processing is performed is less than least square enror dgh in the case 
where shift processing is perfonned is discriminated. Further, In the case where the least square error dg, is less than 

10 the least square error 6^^ (Yes), it is judged that aliasing processing is better As a result, at step S43, high frequency 
band generation method flag is set to 0. On the other hand, in the case where the least square error d^ is the least 
square error 6^ or more (No), it is judged that shift processing is better. As a result, at step S44, high frequency band 
generation method flag is set to 1 . It is to be noted that this high frequency band generation flag can be included into 
the above-described high frequency band signal generation information. 

15 [0074] Subsequently, the processing procedure at the signal decoding apparatus 30 will be explained by using the 
flowchart of FIG. 14. First, at step S50, whether or not flag is 0 Is discriminated with reference to high frequency band 
generation method flag included in high frequency band generation information. In the case where the flag is 0 (Yes), 
generation of high frequency band spectrum is performed by aliasing processing at step S51 . On the other hand, in 
the case where the flag is 1 (No), generation of high frequency band spectrum is perfomned by shift processing at step 

20 S52. 

[0075] Here, the configuration of the entirety of the system to which the signal encoding apparatus 1 0 and the signal 
decoding apparatus 30 in the above-described embodiments are applied is shown in FIG. 15. 
[0076] In FIG. 15, a signal decoding apparatus 200 serves to decode code trains caused to undergo transmission 
between conventional encoding/decoding systems. An example of fomnat of data train that the signal decoding appa- 
ls ratus 200 of the conventional standard handles is shown in FIG. 16A. As shown in FIG. 16A, areas where frame data 
length, main data length and extended data length are recorded exist at header portion from, e.g., address 0 to address 
99, wherein 500 except for header length 1 00 among frame data length 600 is assigned to main data, and code trains 
of the conventional standard are recorded in this area. 

[0077] The signal encoding apparatus 100 has the configuration similar to the above-described signal encoding 

30 apparatus 1 0, and serves to encode, on the basis of time series signal, code train of the conventional frequency band 
limited signal and information for generating, at the time of decoding, band except for the limited frequency band. An 
example of format of data train outputted from the signal encoding apparatus 100 Is shown In FIG. 1 6B. As shown in 
FIG. 16B, areas where frame data length, main data length and extended data length are recorded exist at header 
portion from address 0 to address 99. In addition, 400 is assigned to main data among frame data 600, and area of 

35 1 00 is assigned to extended data. 

[0078] A signal decoding apparatus 201 has the configuration similar to the above-described signal decoding appa- 
ratus 30, and serves to decode main data, and to also decode areas succeeding to address 501 in the case where 
extended data kind of address 500 of FIG. 16B is the standard of this signal decoding apparatus 201 . Thus, the signal 
decoding apparatus 201 decodes frequency band limited code train on the basis of code train encoded by the signal 

40 encoding apparatus 100 and band generation information, and generates signal of new frequency band on the basis 
of the band generation information to superimpose both signals to have ability to obtain final time series signal. 
[0079] On the other hand, since the above-described signal decoding apparatus 200 of the conventional standard 
cannot understand this extended data area, but is designed in such a manner to neglect this extended data area. It 
decodes only main data in a manner conventionally described to have ability to obtain frequency band limited time 

"^5 series signal. 

[0080] While the invention has been described in accordance with certain preferred embodiments thereof illustrated 
in the accompanying drawings and described In the above description in detail, it should be understood by those 
ordinarily skilled in the art that the invention is not limited to the embodiments, but various modifications, alternative 
constructions or equivalents can be implemented without departing from the scope and spirit of the present invention 
50 as set forth and defined by appended claims. 

[0081] For example, while it has been explained in the above-described embodiments that low frequency band signal 
which has been band-limited by low-pass filter is orthogonally transformed every predetemriined frame and is encoded, 
the present Invention is not limited to such Implementation, but may employ such an approach to orthogonally transform 
inputted time series signal to extract low frequency band spectrum to encode the extracted low frequency band spee- 
ds trum. 

[0082] In addition, while the present invention has been explained as the configuration of hardware in the above- 
described embodiments, the present Invention is not limited to such implementation, but an arbitrary processing may 
be also realized by allowing CPU (Central Processing Unit) to execute computer program. In this case, computer 



9 



I 



EP 1 531 551 A1 

program may be provided in the state where it is recorded with respect to recording medium, or may be also provided 
by perfomning transmission thereof through other transmission media such as Intemet 

Industrial Applicability 

5 

[0083] In accordance with the above-described present invention, spectrum of limit band corresponding to a prede- 
temnined frequency band of inputted time series signal is encoded at the encoding side, and mapping information 
indicating a method of mapping is adaptively generated in order to determine time series signal of frequency band to 
be extended at the decoding side on the basis of the mapping of the spectrum of the limit band to decode the encoded 
10 spectrum of the limit band at the decoding side to generate time series signal of limit band, and to generate time series 
signal of extension band to be extended from the spectrum of the limit band on the basis of the mapping Information 
to add the time series signal of the limit band and the time series signal of the extension band to output added signal, 
thereby making it possible to generate optimum hamiontc wave at frequency band which is extended at the time of 
decoding even in the case where complicated hamnonic wave exists. 

15 

Claims 

1 . A signal encoding apparatus adapted for orthogonally transforming an inputted time series signal to encode the 
20 time series signal thus transfonmed, 

the signal encoding apparatus comprising: 

encoding means for encoding spectrum of a limit band corresponding to a predetermined frequency band of 
the inputted time series signal, 

25 mapping Information generating means for adaptively generating mapping information indicating a method of 

mapping in order to determine a time series signal of a frequency band to be extended at the decoding side 
on the basis of the mapping of the spectrum of the limit band, and 

output means for outputting the encoded spectmm of the limit band and the mapping infomnation. 

30 2. The signal encoding apparatus as set forth in claim 1 , 

wherein the mapping is aliasing processing which allows the spectrum of the limit band to undergo aliasing 
at a certain position on the frequency axis, and 

wherein the mapping infonmatlon generating means adaptively determines aliasing position to generate the 
mapping information. 

35 

3. The signal encoding apparatus as set forth in claim 2, 

wherein the mapping infomnation generating means normalizes the spectrum of limit band by spectrum en- 
velope thereof to adaptively determine a position where the nonnalized spectrum of limit band is caused to undergo 
aliasing to generate the mapping infomnation. 

40 

4. The signal encoding apparatus as set forth in claim 2, 

wherein the mapping information generating means calculates distance between the spectrum of the limit 
band which has been caused to undergo aliasing at a certain position on the frequency axis and spectrum of 
extension band to be extended at the decoding side to determine the aliasing position on the basis of the distance. 

45 

5. The signal encoding apparatus as set forth in claim 4, 

wherein the distance is square sum of level difference between spectrum components of the limit band at 
respective frequencies and the spectrum of the extension band. 

50 6. The signal encoding apparatus as set forth in claim 1 , 

wherein the mapping is parallel displacement processing which perfomns parallel displacement of the spec- 
trum of the limit band at a certain position on the frequency axis, and 

wherein the mapping infomnation generating means adaptively determines parallel displacement position to 
generate the mapping Infonmation. 

55 

7. The signal encoding apparatus as set forth in claim 6, 

wherein the mapping infomnation generating means nomnalizes the spectrum of the limit band by the spectrum 
envelope thereof to adaptively determine a position where the normalized spectrum of the limit band is caused to 
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undergo parallel displacement to generate the mapping infomnation. 

8. The signal encoding apparatus as set forth in claim 6, 

wherein the mapping information generating means calculates distance between the spectrum of the limit 
5 band which has been caused to undergo parallel displacement at a certain position on the frequency axis and 

spectrum of extension band to be extended at the decoding side to detemiine the parallel displacement position 
on the basis of the distance. 

9. The signal encoding apparatus as set forth in claim 1 , 

10 wherein the mapping Is aliasing processing for allowing the spectrum of limit band to undergo aliasing at a 

certain position on the frequency axis, or parallel displacement processing for performing parallel displacement of 
the spectrum of the limit band at a certain position on the frequency axis, and 

wherein the mapping infonnation generating means adaptively detenmlnes the aliasing processing or the 
parallel displacement processing in accordance with the state of inputted time series signal to generate the mapping 

15 information. 

10. The signal encoding apparatus as set forth in claim 1 , 

wherein the frequency band to be extended is a frequency band higher than the predetenmined frequency 

band. 

20 

11. A signal encoding method of orthogonally transfonning an inputted time series signal to encode the time series 
signal thus transfomied, 

the signal encoding method including 

an encoding step of encoding spectrum of a limit band coaesponding to a predetemiined frequency band of 
25 the inputted time series signal, 

a mapping information generation step of adaptively generating mapping information indicating a method of 
mapping in order to detemiine a time series signal of a frequency band to be extended at the decoding side on 
the basis of mapping of the spectrum of the limit band, and 

an output step of outputting the encoded spectrum of the limit band and the mapping infonmation. 

30 

12. A program for allowing computer to execute signal encoding processing which orthogonally transforms an inputted 
time series signal to encode the time series signal thus transformed, 

the program Including 

an encoding step of encoding spectrum of a limit band corresponding to a predetermined frequency band of 
35 the inputted time series signal, 

a mapping information generation step of adaptively generating mapping Information indicating a method of 
mapping in order to detemiine a time series signal of a frequency band to be extended at the decoding side on 
the basis of mapping of the spectrum of the limit band, and 

an output step of outputting the encoded spectrum of the limit band and the mapping infomnation. 

40 

13. A computer readable recording medium adapted so that there is recorded program for allowing computer to execute 
signal encoding processing which orthogonally transfomris an inputted time series signal to encode the time series 
signal thus transformed, 

the program Including 

45 an encoding step of encoding spectrum of a limit band corresponding to a predetermined frequency band of 

the inputted time series signal, 

a mapping information generation step of adaptively generating mapping information indicating a method of 

mapping in order to detemnine a time series signal of a frequency band to be extended at the decoding side on 

the basis of mapping of the spectrum of the limit band, and 
50 an output step of outputting the encoded spectrum of the limit band and the mapping infonmation. 

14. A signal decoding apparatus comprising 

input means for inputting encoded spectrum of a limit band corresponding to a predetemriined frequency 
band of a time series signal inputted at the encoding side, and mapping infonnation indicating a method of mapping 
55 adaptively generated In order to detemiine a time series signal of a frequency band to be extended at the decoding 

side on the basis of mapping of the spectrum of the limit band, 

decoding means for decoding the encoded spectrum of the limit band to generate a time series signal of limit 

band. 
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band extending means for determining spectrum of extension band to be extended from the spectrum of the 
limit band on the basis of the mapping infomiation to inverse-orthogonally transfomn the spectrum of the extension 

band to generate a time series signal of extension band, and ... ,tu^„vt«.n=inn 

ouJ.uttingmeansfor adding thetimeserlessignal of thelimit band andthe time senes signal of the extension 

band to output added signal. 

indicating aliasing position inputted from the encoding side. 

ie The sianal decodinq apparatus as set forth in claim 15, 

wHereirthe band extending means nomializes the spectrum of the limit band by the spectrum envelope 
thereof to allow the nornialized spectrum of the limit band to undergo aliasing on the basis of infomnation indicating 
aliasing posttion inputted from the encoding side to detemnine the spectrum of the extension band. 

17 The signal decoding apparatus as set forth in claim 14, » ,u„ 

wherein the mapping is parallel displacement processing which perf omis parallel displacement of the spec- 
trum of the limit band at a certain position on the frequency axis, and 
wierrthe 

indicating parallel displacement position inputted from the encoding side. 

18 The sianal decodinq apparatus as set forni in claim 17, 

wherein the band extending means nomiallzes the spectrum of the limit band ''V J^^^ ^^P^^^^ -J'^Sn 
thereof to perfomi parallel displacement of the nomialized spectojm of the limit band on the basis of infom^at on 
iSngpCXlacemempositionlnputtedfromthe encoding s^^^ 



band. 



1Q The sianal decodinq apparatus as set forth in claim 14, . 

whe eTthe map^ng is aliasing processing for allowing the spectrum of the limit band to undergo aliasing 
atacertar;ositiononthe?requencyaxis.or parallel displacementprocessingforperfo^ 
of the spectrum of the limit band at a certain position on the frequency axis, and „^^«,„„ 

wherein the band extending means selects the aliasing processing or the parallel displac«nent processing 
on the bS se,^ information which has been set in accordance with the state of inputted time series signal 
to determine the spectmm of the extension band. 

of a time series signal inputted at the encoding side, and mapping infomiation indicating a method of mapping 
^iveVgenerSLrdertodet^ 

side on the basis of mapping of the spectrum of the limit band, 

a decoding step of Seceding the encoded spectrum of the limit band to generate a t,me senes signal of limit 



band 



a band extension step of detemiining spectrum of extension band to be extended from the ^Pectrum of the 
limit band on the basis of the mappinginfomiation to inverse-orthogonally transfom, the spectmm of the extension 

band to qenerate a time series signal of extension band, and ,,K»^^„„»i«„ 
an output step of adding the time series signal of the limit band and the time senes signal of the extension 
band to output added signal. 
22. A program for allowing computer to execute a predetermined processing 

TnTufstep onnpulg encoded spectrum of limit band corresponding to a predetemiined frequency band 
of a til sS^li Signal inputted at the erxx^ding side, and mapping infomnation indicating a ^"^hod of mapping 
ad^relygeneratedlnorLtodetemiineatime series signal ofafrequencyband to beextended at the decoding 
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side on the basis of mapping of the spectrum of the limit band, 

a decoding step of decoding the encoded spectrum of the limit band to generate a time series signal of limit 

band, 

a band extension step of determining spectrum of an extension band to be extended from the spectrum of 
the limit band on the basis of the mapping infomnation to inverse-orthogonal ly transfomi the spectrum of the ex- 
tension band to generate a time series signal of extension band, and 

an output step of adding the time series signal of the limit band and the time series signal of the extension 
band to output added signal. 

23. A computer readable recording medium adapted so that there is recorded program for allowing computer to execute 
a predetemnined processing, 
the program including 

an input step of inputting encoded spectrum of limit band corresponding to a predetemnined frequency band 

of a time series signal inputted at the encoding side, and mapping infomiation indicating a method of mapping 
adaptivety generated in order to detennine a time series signal of a frequency band to be extended at the decoding 
side on the basis of mapping of the spectrum of the limit band, 

a decoding step of decoding the encoded spectrum of the limit band to generate a time series signal of limit 

band, 

a band extension step of detemnining spectrum of an extension band to be extended from the spectrum of 
the limit band on the basis of the mapping infonnation to inverse-orthogonally transfonn the spectrum of the ex- 
tension band to generate a time series signal of extension band, and 

an output step of adding the time series signal of the limit band and the time series signal of the extension 
band to output added signal. 
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